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o 

' Abstract. We use Hopf algebras to prove a version of the Littlewood-Richardson rule 

! for skew Schur functions, which implies a conjecture of Assaf and McNamara. We also 

establish skew Littlewood-Richardson rules for Schur P- and Q-functions and noncommu- 
Q \ tative ribbon Schur functions, as well as skew Fieri rules for fc-Schur functions, dual /c-Schur 

' functions, and for the homology of the affine Grassmannian of the symplectic group. 

Assaf and McNamara [1] recently used combinatorics to give an elegant and surprising 
O ' formula for the product of a skew Schur function and a complete homogeneous symmetric 

function. Their paper included a conjectural skew version of the Littlewood-Richardson rule, 
^ ■ and also an appendix by one of us (Lam) with a simple algebraic proof of their formula. We 

, show how these formulas and much more are special cases of a simple formula that holds 

for any pair of dual Hopf algebras. We first establish this Hopf- algebraic formula, and then 
apply it to obtain formulas in some well-known Hopf algebras in combinatorics. 

m 

> ' LA Hopf algebraic formula 



rn 



We assume basic familiarity with Hopf algebras, as found in the opening chapters of the 
book [10]. Let H, H* be a pair of dual Hopf algebras over a field k. This means that there 
is a nondegenerate pairing (-, ■) : if ® H* — > k for which the structure of H* is dual to that 
O I of H and vice-versa. For example, H could be finite-dimensional and H* its linear dual, or 

^ ■ H could be graded with each component finite-dimensional and H* its graded dual. These 

algebras naturally act on each other [10, 1.6.5]: suppose that h E H and a E H* and set 

(1) h ^ a := ^^(/i, 02)01 and a^h := ^^(/i2, o)/ii . 

I (We use Sweedler notation for the coproduct. Ah = X] ^1 ® ^2-) These left actions are the 

adjoints of right multiplication: for g,h E H and a,b E H*, 

{g,h^a) = {g-h,a) and {a ^ h,b) = {h,b-a). 

This shows that H* is a left if-module under the action in (1). In fact, H* is a left if-module 
algebra, meaning that for a,b E H* and h E H, 

(2) h^{a-b) = ^(/ii ^ o) ■ (/i2 ^ b) . 

Recall that the counit e: if — > k and antipode S: H ^ H satisfy ^ hi ■ e{h2) = h and 
J2 hi ■ S{h2) = e{h) ■ Ih for all hEH. 
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Lemma 1. For g,h ^ H and a G H*, we have 

(3) {a^9)-h = J2(S{h,) ^a)^{g- h) . 
Proof. Let b G H*. We prove first the formula 

(4) (/i - 6) ■ a = 5^ /ii - (6 • (5(/i2) ^ a)) . 

(Tliis is essentially (*) in the proof of Lemma 2.1.4 in [10].) Expanding the sum using (2) 
and coassociativity, (A ® 1) o A{h) = (1 A) o A{h) = ^ /ii ® /i2 ® h^, gives 

Y^hi^ib- {S{h,) - a)) = Y^ihi ^ b) ■ {h2 - {S{h) - a)) 

(5) = Y^ih - b) ■ {{h, ■ S{h,)) - a) 

(6) = (h^b)-a. 

Here, (5) follows as H* is an if-module and (6) from the antipode and counit conditions. 
Note that ((a ^ g) ■ h, b) = {a ^ g , h ^ b) = {g, {h ^ b) ■ a). Using (4) this becomes 

{g,J2hi-ib-{S{h2)^a))) = J2{9-hub-{S{h,)^a)) 

= {J2{S{h2)^a)^{g-h),b), 

which proves the lemma, as this holds for all b G H*. □ 

Remark 2. This proof is identical to the argument in the appendix to [1], where h was a 
complete homogeneous symmetric function in the Hopf algebra H of symmetric functions. 

2. Application to distinguished bases 

We apply Lemma 1 to produce skew Littlewood- Richardson rules for several Hopf algebras 
in algebraic combinatorics. We isolate the common features of those arguments. 

In the notation of Section 1, let {Lx} C H and {Rx} C H* be dual bases indexed by 
some set V, so {Lx,R^) = Sx,fj. for A,/x G P. Define structure constants for H and H* via 

(7) Lx-L^ = ^(^-) = = 

u A, /I fi 

(8) Rx-R^ = $^cj:,^i?. A(i?.) = 5^&j:,Mi?A®i?M = 

The skew elements L^^j^ and Ry/^ defined above co-multiply according to 

(9) A(L./J = 5^c;,,,L.®L, A(i?,/.) = Y.bl^^^R^®Rp. 

7r,p 7r,p 

(Note that the structure of H* can be recovered from the structure of H . Thus, we may 
suppress the analogs of (8) and the second formula in (9) in the coming sections.) 
Finally, suppose that the antipode acts on H in the L-basis according to the formula 

(10) S{L,) = (-1)^('')V 

for some functions e: V and (■)"'': V —>-V. Then Lemma 1 takes the following form. 
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Theorem 3 (Algebraic Littlewood- Richardson formula). For any \,^,a,T G V, we have 

(11) ■ L^/^ = (-1)'^'^ <P,- ^A-,pT L,y,- . 

Swapping L ^ R and b ^ c in {11) yields the analog for the skew elements R^/\ in H*. 

Proof. The actions in (1) together with the second formulas for the coproducts in (7) and 
(8) show that L^ = L^jx and Lx R^ = R^/x- Now use (3) and (7)-(10) to obtain 

L,,x ■ L,,„ = {Rx - L,) . L^i^ = ((V - Rx) - {L, ■ L^)) 



This equals the right hand side of (11), since Rx- = L^+jx-- □ 

Remark 4. The condition (10) is highly restrictive. It implies that the antipode S, as a 
linear map, is conjugate to a signed permutation matrix. Nevertheless, it holds for the Hopf 
algebras we consider. More generally, it holds if either H or H* is commutative, for then S 
is an involution [10, Cor. 1.5.12]. 

3. Skew Littlewood-Richardson rule for Schur functions 

The commutative Hopf algebra A of symmetric functions is graded and self-dual under 
the Hall inner product (■,-):A®A— i>Q. A systematic study of A from a Hopf algebra 
perspective appears in [14]. We follow the definitions and notation in Chapter I of [8]. The 
Schur basis of A (indexed by partitions) is self-dual, so (7) and (9) become 

(12) sx-s^ = ^c^^s^ A(s^) = "^cl^sx^Sf, = ^ s^/^ ® s^, 

u \,fj, fJ. 

(13) A{Sr/a) = ^Clp^^ S^®Sp, 

■K,p 

where the cj;'^ are the Littlewood-Richardson coefficients and the Su/fi are the skew Schur 
functions [8, 1.5]. Combinatorial expressions for the Cx^^ and inner products {s^/x,Sr/a) are 
derived using the Hopf algebraic structure of A in [14]. The coefficients c^^ o- occur in the 
triple product s-^ ■ Sp ■ s^, 



c. 



7r, p,cr 



Write p' for the conjugate (matrix-transpose) of p. Then the action of the antipode is 
(14) S{sp) = (-1)1^1 V, 

which is just a twisted form of the fundamental involution u that sends Sp to Sp/. Indeed, 
the formula J2i+j=ni~^y^i^j ~ ^o,n shows that (14) holds on the generators | n > 1} 
of A. The validity of (14) follows as both S and u are algebra maps. 
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Since c^-p/ = unless |p| = |A/A |, we may write (11) as 
(15) s,/, ■ s,/„ = Yl (-1)"/'"' <p,. c^-,p' <t s,yx- . 

■K,p,X-,n+ 

We next formulate a combinatorial version of (15). Given partitions p and a, form the 
skew shape p* a hj placing p southwest of a. Thus, 

if p = [-jj-H and a = gin then p * a = nn . 



Similarly, if i? is a tableau of shape p and S a tableau of shape a, then i? * is the skew 
tableau of shape p * a obtained by placing R southwest of S. Fix a tableau T of shape 
T. The Littlewood-Richardson coefficient cj^ is the number of pairs {R, S) of tableaux of 
respective shapes p and cr with R * S Knuth-equivalent to T. See [3, Ch. 5, Cor. 2(v)]. 
Similarly, c^p o. is the number of triples (P, R, S) of tableaux of respective shapes vr, p, and 
a with P * R* S Knuth-equivalent to T. 

Write sh(S') for the shape of a tableau 5* and S =k T if S* is Knuth-equivalent to T. 

Lemma 5. Let a, t be partitions and fix a tableau T of shape r. Then 

the sum taken over triples {R~, R^, S) of tableaux with sh(S') = a and R~ *R'^*S =k T. □ 

Note that (p/X)' = p'/X' and the operation * makes sense for skew tableaux. If S* is a 
tableau of skew shape p/X, put \S\ = \p/\\ = \p\ — |A|. 

Theorem 6 (Skew Littlewood-Richardson rule). Let A, p, cr, r be partitions and fix a tableau 
T of shape r. Then 

(16) Si,/x-Sr/a = ■^A'+A" ' 

the sum taken over triples {S~, S~^, S) of skew tableaux of respective shapes (A/A^)', p~^/p, 
and a such that * * S =k T. 

Remark 7. If T is the unique Yamanouchi tableau of shape r whose ith row contains only 
the letter i, then this is almost Conjecture 6.1 in [1]. Indeed, in this case S is Yamanouchi 
of shape a, so the sum is really over pairs of tableaux, and this explains the a- Yamanouchi 
condition in [1]. The difference lies in the tableau S~ and the reading word condition in [1]. 
It is an exercise in tableaux combinatorics that there is a bijection between the indices 
{S~, S'^) of Theorem 6 and the corresponding indices of Conjecture 6.1 in [1]. 

Proof of Theorem 6. We reinterpret (15) in terms of tableaux. Let {R~, R'^, S) be a triple 
of tableaux of partition shape with sh(S') = cr and R~ * i?"*" * 5* =k T. If sh(i?~) = p, then 
by [3, Ch. 5, Cor. 2(i)], c^-^/ = c^\-y p counts skew tableaux of shape (A/A^)' with 

=K R~ ■ Likewise, if sh(i?"'") = tt, then cj^^ counts skew tableaux of shape p^ / p with 

=K R'^ ■ Now (15) may be written as 

summing over skew tableaux (i?~, R\ S^, S\ S) with R"^ of partition shape, sh(S') = a, 
R-*R+*S=K T, sh(5+) = p+/p, sh{S-) = (A/A-)', and 5± =k R^- 
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Finally, note that R"^ is the unique tableau of partition shape Knuth-equivalent to 5*^. 
Since S*" * S*^ * 5* is Knuth-equivalent to T (by transitivity of =k), we omit the unnecessary 
tableaux from the indices of summation and reach the statement of the theorem. □ 

4. Skew Littlewood-Richardson rule for Schur P- and Q-functions 

The self-dual Hopf algebra of symmetric functions has a natural self-dual subalgebra Q. 
This has dual bases the Schur P- and Q-functions [8, III. 8], which are indexed by strict 
partitions A : Ai > • ■ ■ > A; > 0. Write ^(A) = / for the length of the partition A. As in 
Section 3, the constants and skew functions in the structure equations 

(17) Qx-Q, = Y.3l,Q^ ^W^) = E^A^M^^^Q,. = 

V \,fj, /J, 

(18) HQ^/a) = 5^ /.^p,. ® Qp 

7r,p 

have combinatorial interpretations (see below). Also, each basis {-Pa} and {Q\} is almost 
self-dual in that Pa = 2-^(^)Qa and g^;^^ = 2^(A)+^(M)-n^)/^i^^. 

The algebra Q is generated by the special Q-functions = Q{n) '■= 'l2i+j=n^i^j [8; 
(8.1)]. This implies that S{qn) = (— l)"g„, from which we deduce that 

S{Q,) = {-1)\P\Q,. 

As fx-p = unless \p\ = |A/A^|, we may write the algebraic rule (11) as 

(19) Q,/X ■ Qr/a = Yl (-1)"/'"' f:,p,a 9x^,p Q,VX- , 

7r,p,A~ /i+ 

with a similar identity holding for P^/x ■ Pr/a (swapping P ^ Q and f ^ g)- 

We formulate two combinatorial versions of (19). Strict partitions X, fi are written as 
shifted Young diagrams (where row i begins in column i). Skew shifted shapes A//i are 
defined in the obvious manner: 

if A = 431 = ^ and /i = 31 = then X/fx = = ^• 

In what follows, tableaux means semi-standard (skew) shifted tableaux on a marked alpha- 
bet [8, III. 8]. We use shifted versions of the jeu-de-taquin and plactic equivalence from [11] 
and [12], denoting the corresponding relations by =sj and =sp, respectively. Given tableaux 
R, S, T, we write R* S =sp T when representative words u, v, w (built via "mread" [12, §2]) 
of the corresponding shifted plactic classes satisfy uv =sp w. 

Stembridge notes (following [13, Prop. 8.2]) that for a fixed tableau M of shape /i, 

(20) fx^^ = #{skew tableaux L : sh(L) = Z//A and L =sj M}. 

Serrano has a similar description of these coefficients in terms of =sp. Fixing a tableau T of 
shape r, it follows from [12, Cor. 1.15] that the coefficient /J^p^o- P-k- Pp- Pa = YIt fn,p,aPT 
is given by 

(21) f;,p,a = #{(P,i?,5):sh(P) = 7r, sh(i?)=p, sh(5) = a, and P * i? * 5 T}. 

If T is a tableau of shape A, write i{T) for i{X). The formula relating the g^s and /'s 
combines with (20) and (21) to give our next result. 
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Theorem 8 (Skew Littlewood- Richardson rule). Let X,fi,a,T be shifted partitions and fix 
a tableau T of shape r. Then 

(22) g,/A • Qr/. = 2^(«-)+^(^")+^(^-)+^('^)-^W-^(^") Q,y,- , 

the sum taken over quintuples {R^, R\ S^, S\ S) with i?^ of partition shape, sh.{S) = a, 
R-*R+*S =sp T, sh{S+) = 11+ 111, sh(5~) = (A/A"), and =sj R^. □ 

Serrano conjectures an elegant combinatorial description [12, Conj. 2.12 and Cor. 2.13] 
of the structure constants g^^^ in (17): For any tableau M of shape /i, he conjectured 

(23) g^^ = T^jskew tableaux L : sh(L) = z//A and L =sp M}. 

(Note that if S,T are tableaux, then S =sp T does not necessarily imply that S =sj T.) 
This leads to a conjectural reformulation of Theorem 8 in the spirit of Theorem 6. 

Conjecture 1 (Conjectural Skew Littlewood-Richardson rule). Let X,fi,a,T be partitions 
and fix a tableau T of shape r. Then 

(24) Q,/x-Qr/a = J2^-lf'^Q,yx- , 

the sum taken over triples {S^, S\ S) of skew tableaux of respective shapes (A/A^), 
and a such that S~ * * S =sp T. 

Proof. There is a unique shifted tableau R in any shifted plactic class [12, Thm. 2.8]. So 
the conditions 5*^ =sp -R^ and R~ * i?+ * S =sp T in (21) and (23) may be replaced with 
the single condition * S+ * S =sp T. □ 



5. Skew Littlewood-Richardson rule for noncommutative Schur functions 

The Hopf algebra of noncommutative symmetric functions was introduced, independently, 
in [4, 9] as the (graded) dual to the commutative Hopf algebra of quasisymmetric functions. 
We consider the dual bases (indexed by compositions) {Fa} of Gessel's quasisymmetric 
functions and {Ra} of noncommutative ribbon Schur functions. The structure constants in 

(25) Ra-Rf3 = Y.^lpR', HR-y) = 5Z<;3^a®^/3 = i?7//3 ® ^/^ 

(26) A{Rr/^) = Y.clp^^R^®Rp 

may be given combinatorial meaning via the descent map d : 6„ r„ from permutations to 
compositions and a section of it w: r„ — (5„. These maps are linked via ribbon diagrams^ 
edge-connected skew Young diagrams (written in the french style), with no 2 x 2 subdiagram 
present. By way of example, 

d : 148623795 3141, w: 3141 ^ 789623451. 

(In the intermediate step for d(w), new rows in the ribbon begin at descents of w. In the 
intermediate step for w(a), the boxes in the ribbon are filled left-to-right, bottom-to-top.) 
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A ribbon a may be extended by a ribbon /3 in two ways: affixing /3 to the rightmost edge 
or bottommost edge of a (written a<^(5 and a a/3, respectively): 

rrn rrn U-H rrn 

311^31: 31A41: 

If a ribbon 7 is formed from a and /3 in either of these two ways, we write 7 G aO/?. 
The coefficient is 1, if 7 G aO/5, and otherwise. If * is the shifted shuffie product 
on permutations (see (3.4) in [9]), then the coefficient cj^ is the number of words w in 
w(q;) * w(/?) such that d(w) = 7. The coefficient c^^p^o- has the analogous description. 
Antipode formulas for the distinquished bases were found, independently, in [2, 9]: 

5(F„) = (-1)I"If,. and S{R^) = {-IpRa' , 

where a' is the conjugate of a (in the sense of french style skew partitions). For example, 
(3141) = 211311. The descriptions of the antipode and structure constants in (25) and 

(26) give a formula for the product of two skew ribbon Schur functions. 

Theorem 9 (Skew Littlewood-Richardson rule). Let a, (3, a, t be compositions. Then 

Rp/a ■ Rr/a = ^("1)'^' Rp+/a- , 

the sum taken over factorizations a G a~Op', extensions G /SOtt, and words w in the 
shuffle product \n{'k) * w{p) * w(cr) such that d{w) = r. □ 

Remark 10. The nonzero skew ribbon Schur functions Rp/a do not correspond to skew 
ribbon shapes in a simple way. For example. 111 is not a (connected) sub-ribbon of 221, yet 
-R221/111 = R2 + Rii 7^ 0. Contrast this with the skew functions -F^/o, where F^/q, 7^ if and 
only if /? G uOa for some ribbon u. That is, F^/a = F^^. Thus we may view a as the last 
|a| boxes of the ribbon [3 and as the complementary ribbon oj. Interpreting F^/q, ■ Fr/a 
alternately as a product of ordinary functions or skew functions yields the curious identity 

(27) ■ F./. = ^ c//^^^/^ ^7 = E (-1)'" ^^^',p C V/"- • 

6. Skew fc-PiERi rule for A;-Schur functions 

Fix an integer k > 1. Let A(fc) denote the Hopf subalgebra of the Hopf algebra of 
symmetric functions generated by the homogeneous symmetric functions hi, h2, ■ ■ ■ , hk. Let 
clenote the Hopf-dual quotient Hopf algebra of symmetric functions. We consider 
the dual bases {s^^^} C A(fc) and {F^''^} C A*^*^) of fc-Schur functions and dual fc-Schur 
functions of [5, 7], also called strong Schur functions and weak Schur functions in [5]. The 
/c-Schur functions were ffist introduced by Lapointe, Lascoux, and Morse in the context of 
Macdonald polynomials, and were later shown by Lam to represent Schubert classes in the 
affine Grassmannian of SL(fc+l, C). We refer the reader to the references in [5]. 

Here A varies over all A;-bounded partitions, that is, those partitions satisfying Ai < k. 
There is an involution A A'^'= on fc-bounded partitions called k- conjugation. We have 

5(sf ) = (-1)1^1^1 and 5(Ff ) = (-1)1 ViS. 
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If A = (r) is a one-part partition, then s^^^ = hr is a homogeneous symmetric function. 
We have the fc-Pieri and dual fc-Pieri rules [5, 7] (called weak and strong Pieri rules in [5]) 

(28) ■hr=Yl Fi'^ ■K= Yl F'"' 

for r < k. Here A -w^ ^ denotes an r-weak strip connecting A and fi — present if and only 
if both n/X and /\^^ are horizontal r-strips. The notation A^^/^ denotes an r-strong 
strip as introduced in [5], which we will not define here. The terminology comes from the 
relationship with the weak and strong (Bruhat) orders of the affine symmetric group. We 
remark that there may be distinct strong strips A — ^ and (A -^r A^)' which start and end 
at the same partition, so that the second Pieri rule of (28) may have multiplicities. (Strictly 
speaking, the strong strips in [5] are built on (fc + l)-cores, and our A — /i denotes the strips 
obtained after applying a bijection between {k + l)-cores and fc-bounded partitions.) 

We define skew functions s^^^^ and F^j^^ using (7) and (8). There is an explicit combi- 
natorial description of F^^^ in terms of the weak tableaux of [5], but only a conjectured 
combinatorial description of s^^'j^ [5, Conj. 4.18(3)]. 

Theorem 11 (Skew A;-Pieri (or weak Pieri) rule). For k-hounded partitions A, /i, and r <k, 

• = E (-1)' E 4'?/.- 

Proof. In Theorem 3, take Lr/a = K- For c^^p^^, use the formula A(/ir) = J2i+j=r^i ® ^i' 
and for u,^. and 6^^, use (28). □ 



Theorem 12 (Skew dual /c-Pieri (or strong Pieri) rule). For k-hounded partitions A,/i, and 
r <k, 

fHu. ■ = E (-1)' E "i*,.- 

i+j=r A— >iA+ 

Proof. Identical to the proof of Theorem 11. □ 
As an example, let /c = 2, r = 2, = (2, 1, 1), and A = (1). Then Theorem 11 states that 

(2) I, _ (2) _ (2) 

■^211/1 ■ ""2 ~ "^2211/1 "^2111 5 

which one can verify using (28) and the expansions sf^-^^^-^ = s^2i +^ni ^'^d ■^2211/1 ~ ^ ^2111 + 
S221- Theorem 12 states that 

17(2) L q p(2) I r rp{2) . q p{2) , q ei(2) r\ 771(2) q 17(2) n 77(2) 

-^211/1 ■ "'2 ~ '-' -^222/1 -'^2211/1 -'^21111/1 -^111111/1 ^^-^221 '-'-'^2111 ^-'^lllll- 

(2) (2) (2) 

One can verify that both sides are equal to 6F221 + 5F2\{]^ + AF^im. 
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7. Skew Pieri rule for affine Grassmannian of the symplectic group 

Fix 77, > 1. The Hopf algebra of Section 4 contains a Hopf subalgebra generated by 
the Schur P-functions Pi, P3, . . . , Pjn-i- In [6], it was shown that is isomorphic to the 
homology ring H^{Grsp(2n,c)) of the affine Grassmannian of the symplectic group Sp(2n, C). 
A distinguished basis {Pi,"^} C fi(„), representing the Schubert basis, was studied there. The 
symmetric functions PiT^ are shifted versions of the fc-Schur functions of Section 6. 

The indexing set for the basis {PiT''} is the set C° of affine Grassmannian type C per- 
mutations: they are the minimal length coset representatives of Cn in C„. A lower Bruhat 
order ideal Z (Z Cn of the affine type C Weyl group is defined in [6]. Let Zj C Z denote 
those V ^ Z with length i{v) = j. For each v & Z, there is a nonnegative integer c{v) G Z>o, 
called the number of components of v. We note that c(id) = 0. With this notation, for each 
1 < j < 2n — 1, we have the Pieri rule [6, Thms. 1.3 and 1.4] 

(29) P(") -Pj = 2'^"^"' ' 

where the sum is over all v G Zj such that vw G C°, and i{vw) = i{v) + i{w). 

It follows from the discussion in Section 4 that the antipode acts on the Pj by S{Pj) = 

i-iyPj. We define P^/^ using (7). 

Theorem 13 (Skew Pieri rule). For w,v & C^, and r < 2n — 1, 

w/v ' / J \ / / J uw/z '-V ' 

i+j=r uGZi 

where the sum is over all u E Zi and z G Zj such that uw, z~^v G i{uw) = i{u) + i{w), 
and e{z-^v) + i{z) =e{v). 

Proof. In Theorem 3, take L^/o- = P^ and use (29). For the constants c^^^^^, use the formula 

A{Pr) = 1®P, + P,®l + 2 J2 P'-j ® P3 . 

0<j<r 

If < j < r, the product clp^^h^.p,hlf^^ in (11) becomes 2 ■ 2'=(")-i ■ 2<'^-^ = 2'=W+^(^)-i. If 
J = (resp., j = r), it becomes 1.2''=(")-^-l = 2^(")+^(^)-i (resp., 1.1.2<'^-^ = 2^(")+^W-i). □ 
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